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METHOD AND APPARATUS FOR PACKING 



AND DECODING AUDIO AND OTHER DATA 



Field of Invention 

This invention relates to audio compression. In particular, this invention relates to a 
method and apparatus for compressing and decoding audio and other data in a standard 
format. 

Backgroimd of the Invention 

The Audio Engineering Society (AES) has developed a standard for the serial 
transmission of two channels of audio data over shielded twisted-pair conductors, as 
embodied in AES Standard AES3-1992 titled "AES Recommended Practice for Digital 
Audio Engineering — Serial Transmission Format for Two-Chaimel Linearly Represented 
Digital Audio Data", which is incorporated herein by reference. 

The AES standard for two-channel serial transmission is designed to accommodate a 
signal having audio sub-frames of a fixed transport length. The standard accommodates either 
24-bit audio sub-frames, or 20-bit audio sub-frames with an additional four-bit auxiliary data 
field. This results in an inefficient use of bandwidth when used with signals having different 
resolutions. Moreover, the audio compression standard is adapted to transmit only a limited 
amount of data relating to the audio stream. There is a need for a system which can 
accommodate different transport lengths within a single audio stream, and which allows for 
the ability to embed other data. 

Data compression is commonly used in the transmission of digital audio signals in 
broadcasting and network communications. The compression of audio data increases the rate 
at which data can be transmitted in a serial format. A compression technique, called apt-X, 
has been developed which can be employed to compress audio signals in 16-bit, 20-bit, or 24- 
bit resolution AES format by a factor of 4 to 1 . The apt-X compressed audio can then be 
formatted to be carried on AES equipment. However, previous implementations of apt-X 
compression required the number and resolution of the signals input to the compression 
system to be determined in advance, and did not allow the number and resolution of the 
signals carried to be easily changed, nor did it allow the transportation of additional data. 
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Summarv of the Invention 

The present invention provides a method and apparatus for compressing digital data 
w^hich is particularly adapted for the compression of audio streams containing audio and other 
data. I'he method and apparatus of the invention provides a means for packing compressed 
audio and other data within the available bits for an audio sub-frame under the current AES 
standard (ANSI S4.40-1992) in a way that the packing method used can be automatically 
detected and decoded at the receiving station. 

According to the invention, the audio signal is divided into "compression packets" 
consisting of four word pairs of left and right words. The first word pair in each compression 
packet is tagged with a unique identifier, and is provided with configuration information 
which allows the audio and other data to be decoded at the receiving station. In the preferred 
embodiment the first significant bit of the first left word (x or z sub-frame) is tagged, and the 
second most significant bit of the first left word is provided with configuration information 
which, over an entire "compression block" of 48 compression packets, constructs a 48-bit 
word consisting of six bytes of data specifying the manner in which the compressed audio and 
other data is packed. 

The method and apparatus of the invention accordingly provides a universal standard 
which is able to compress digital audio and other data to accommodate 16-, 20- and 24-bit 
resolutions and transmit up to eight channels of audio information in a variety of formats, 
including formats in which different chaimels have sub-frames with different resolutions. 

The present invention thus provides a method of compressing digital audio data and 
other data into an audio signal for transmission to a receiving station, comprising the steps of: 

a. dividing the audio signal into compression blocks, each compression block consisting of a 
plurality of compression packets, each compression packet consisting of a plurality of words, 

b. providing one word in each compression packet with a component of configuration data, 
whereby a compression block contains sufficient configuration information to identify a 
manner of packing data into the compression block, c. tagging one word in each compression 
packet to identify the tagged word as a word containing configuration information, d. packing 
compressed audio and other data into remaining space within the compression packet, and e. 
transmitting the compression packets in a predetermined sequence to a receiving station, 
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wherein the receiving station constructs the configuration information fi'om the tagged words 
in a compression block and decodes the compressed audio data and other data according to 
the configuration information. 

The present invention fiirther provides an apparatus for adding digital audio data and 
other data into an audio signal for transmission to a receiving station, comprising an encoder 
for dividing the audio signal into compression blocks, each compression block consisting of a 
plurality of compression packets, each compression packet consisting of a plurality of words, 
providing one word in each compression packet with a component of configuration data, 
whereby a compression block contains sufficient configuration information to identify a 
manner of packing data into the compression block, tagging one word in each compression 
packet to identify the tagged word as a word containing configuration information, and 
packing compressed audio and other data into remaining space within the compression 
packet; a transmitter for transmitting the compression packets in a predetermined sequence to 
a receiving station; and a decoder at the receiving station for constructing the configuration 
information fi*om the tagged words in a compression block and decoding the compressed 
audio data and other data firom the configuration information. 

In further aspects of the method and apparatus of the invention: each compression 
packet consists of four word pairs; a first most significant bit of a first word pair is tagged; a 
second most significant bit of the first word pair holds the component of configuration data; 
each compression block consists of 48 compression packets; the compression information 
comprises synchronization information, transport identification information, and data 
identification information; one or more bytes are dedicated to the synchronization 
information, one byte is dedicated to transport identification information and one byte is 
dedicated to data identification information; each word has 24, 20 or 16 bits; the audio data 
comprises a plurality of channels and is packed into the remaining space in the compression 
packet leaving no empty bits between channel data; and/or the audio data and other data 
comprises metadata, linear time code data and channel status data. 



Brief Description of the Drawings 

In drawings which illustrate by way of example only a preferred embodiment of the 
invention. 
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Figure 1 is a schematic representation of a 32 bit AES audio sub-frame according to 
the AES standard ANSI S4.40-1992, 

Figure 2 is a schematic representation of a transition between blocks of compressed 
two-channel audio data, 

Figure 3 is a schematic representation of a compression packet according to the 
invention. 

Figure 4 illustrates the preferred byte assignments for the six bytes of configuration 
information in a compression block. 

Figure 5 is a schematic representation of an example of a compression packet 
according to the invention for packing 20-bit resolution audio into a 1 6-bit transport. 

Figure 6 is a schematic representation of a channel status frame, and 

Figure 7 is a chart illustrating examples of variations in compressed packing which 
may be implemented according to the invention. 

Detailed Description of the Livention 

Figure 1 illustrates a typical 32 bit audio sub-frame according to AES standard ANSI 
S4.40-1992, which is incorporated herein by reference, showing the least significant bits 
(LSB) on the left and the most significant bits (MSB) on the right. The MSB comprise bits 
representing the parity (P), channel status (C), user (U) and validity (V) in bits 0 to 3, 
respectively. Audio data is packed into bits 4 to 27, which will thus accommodate up to 24-bit 
resolution. The sub-frame is transmitted LSB first, so that the preamble is the leading 
information in the sub-frame. In systems which are capable of transmitting only 20-bit or 16- 
bit sub-frames, the least significant bits of the audio segment of the sub-frame are dropped. 

An audio frame is composed of two such sub-frames. According to AES3-1992, each 
block of compressed two-channel audio comprises 192 audio frames. Figure 2 illustrates the 
transition between blocks in a compressed two-channel audio signal, the designation z 
indicating the start of each new block (equivalent to an x sub-frame, but designated z to 
signify the first sub-frame of a new block). 
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With a compression rate of 4:1, under the standard AES transport system there is a 
reduced word rate for the compression data of 12kHz from an original sample rate of 48 kHz. 
According to the invention this allows for the transport of a "compression packet" consisting 
of four word pairs, each word pair being transported at 48 kHz so the complete sequence of 
four word pairs is repeated at a rate of 12 kHz. The first word pair in each compression packet 
is tagged with a imique identifier, and is provided with a component of configuration 
information which allows the manner in which the data is packed into the compression packet 
to be determined so the data can be decoded at the receiving station. 

Figure 3 illustrates a compression packet according to the invention, having word 
pairs each respectively consisting of left and right words. The length of the words is 
determined by the selected transport length and may be either 24, 20 or 16 bits. In the 
preferred embodiment of the invention, the first most significant bit of the first left word (x or 
z sub-frame) in the compression packet is tagged with a marker, for example "1" in the 
embodiment shown in Figure 3, to identify it as an x (or z) sub-frame containing 
configuration information. The first bit in each remaining left word in the compression packet 
is set to "0". 

The second most significant bit of the first left word (x or z sub-frame) in the first 
word pair of a compression packet is provided with a component of configuration information 
such that, over an entire "compression block" consisting of 192 audio frames (48 
compression packets), the configuration information components construct configuration 
information, in the preferred embodiment a 48 bit word consisting of six bytes of information, 
specifying the manner in which compressed audio and other data are packed within the 
compression block. 

Figure 4 illustrates the preferred byte assignments for the six bytes of configuration 
information in a compression block, as follows: 
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Byte 0 

First Synchronization word 

Byte 1 

Second Synchronization word 

Byte 2 



"a" Transport length 


00 


= 16-bit 




01 


= 18-bit 




10 


= 20-bit 




■ 11 


= 24-bit 


"b" Audio resolution 


00 


= 16-bit 




01 


= 18-bit 




10 


= 20-bit 




11 


= 24-bit 



Byte 3 





Number of audio channels 


0001 




5.1+2 






0010 




6+2 






0100 




4 






1110 




6 






1000 




8 






1101 




5.1 






1110 




7.1 






nil 




Illegal State 




Other values 




Not Defined 


"d" 


Channel Status 


1 




Channel Status embedded 




(4 bits required) 


0 




No Channel Status 


"e" 


LTC 


1 




Linear Time Code embedded 




(4 bits required) 


0 




No LTC 




Metadata 


1 




Metadata embedded 




(10 bits required) 


0 




No Metadata 




reserved for future use 


0 




Default state 



Some audio equipment does not support the transmission of AES status (bit 30 in the 
AES subframe), so the compression packets do not need to be synchronized with the 
beginning of the 192 frame AES standard block. Additionally, some 16-bit transmission 
equipment does not provide a transparent path for 16-bit data, which usually manifests in the 
value 8000h being rounded up to 800 1h. This will not affect audio data because SOOOh is an 
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invalid value for audio data, but in other data the value of 8000h will occur. To avoid 
problems due to rounding up, a special configuration data setup of all "1" (including 
synchronization bits) may be reserved for 16-bit transport; 20-bit resolution; 5.1 audio 
channels; and metadata; to which special decoding rules will apply. 

The audio and other data is packed into the compression packet in a predetermined 
order, which is recognized at the receiving station for decoding. In the preferred embodiment 
the compressed audio and selected other data are packed into the remaining available space in 
the compression packet in the following order: 

Compressed audio channels 
Metadata 

Linear time code (LTC) 

Channel Status 

Additional data (as required) 

The compressed audio is packed into the MSB of the next available space (the left 
word having priority over the right), and all data following the MSB of the first left data word 
is left-justified into the remaining space. Where an LFE channel is used (for example in 5.1 
and 7.1 formats), the LFE channel is packed as the fourth audio charmel. Where the number 
of channels is 6+2 or 5.1+2, the first number indicates the number of channels selected at the 
chosen (higher) resolution followed by two channels at the next lower resolution, and the 
channels are packed in that order. Figure 5 illustrates as an example a compression packet in 
which 20-bit resolution audio is packed into a 16-bit transport along with metadata and 
channel status information. 

Metadata is packed into a 10-bit word having one start bit, eight bits of data, even 
parity and one stop bit. It is expected that metadata will occur at a rate of less than 12 kHz, so 
not every compression packet will contain metadata data. However, every compression packet 
has a metadata word, so the MSB (bit 9) of the 10-bit word is used to indicate that valid data 
is present. Bit 8 holds the parity and bits 7 to 0 hold the 8-bit data word. 

The linear time code (LTC) is usually represented as a linear audio channel, and may 
be sampled at a rate of 48 kHz with a one-bit resolution. Thus, with the four frame 
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compression packet four bits are required to represent the four samples. When the data is 
converted back into Unear audio, care must be taken to round the edges. 

The channel status does not need to be updated on every frame, so a slow response 
can be tolerated. Alio, not every bit of channel status needs to be replicated. The channel 
status is carried in a 48-word sequence (one word per compression packet) of 4-bit words. 
The first 4-bit word is a header indicating which of the possible 8 channels of status is 
present, and the remaining 47 words carry up to 188 bits of status. This sequence, repeated for 
each channel in sequence, gives a transfer rate of 32 ms. 

The channel status header is present in the first compression packet in each 
compression block, and thus coincides with the first bit of the configuration data. The channel 
status cycles through each channel in turn. The channel status header has values 1 to 8, 
indicating the channel number to which the status information which follows is associated. At 
present only "channel mode", "channel origin" and "channel destination" need to be stored 
for each channel; the remaining data is essentially meaningless in association with 
compressed audio data, but this space is reserved for possible future use in case more status 
information is required in the fiiture. Figure 6 illustrates an example of a channel status frame 
according to the invention. 

Figure 7 illustrates (non-limiting) examples of variations in compressed packing 
which may be implemented according to the invention, in which M represents metadata, T 
represents the time code and S represents the channel status. 

A preferred embodiment of the invention having been thus described by way of 
example only, it will be apparent to those skilled in the art that certain modifications and 
adaptations may be made without departing from the scope of the invention, as set out in the 
appended claims. 



